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Abstract 

o ; 

04 . We discuss contemporaneous aggregation of independent copies of a triangular array of random-coefficient 

AR(1) processes with i.i.d. innovations belonging to the domain of attraction of an infinitely divisible law 
W . The limiting aggregated process is shown to exist, under general assumptions on W and the mixing 
distribution, and is represented as a mixed infinitely divisible moving-average {X(t)} in (|1.4|) . Partial sums 
'■^ ■ process of {-£(£)} is discussed under the assumption EW 2 < oo and a mixing density regularly varying at 

the "unit root" x = 1 with exponent (3 > 0. We show that the above partial sums process may exhibit four 
different limit behaviors depending on (3 and the Levy triplet of W. Finally, we study the disaggregation 
problem for {3L(t)} in spirit of Leipus et al. (2006) and obtain the weak consistency of the corresponding 
estimator of </>(x) in a suitable Li —space. 
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^ ■ 1 Introduction 

The present paper discusses contemporaneous aggregation of N independent copies 

X i i N) (t) = a l xl N \t-l)+e ( i N \t), teZ, i = l,2,---,N (1.1) 

a 

of random-coefficient AR(1) process I^ft) = aX^ N \t - 1) + £ W (t), t G Z, where {e^ N \t), t G Z}, N = 
1, 2, • • • is a triangular array of i.i.d. random variables in the domain of attraction of an infinitely divisible 
law W: 

N 

I> (A °(*) W (1-2) 

i=l 

and where a is a r.v., independent of {e^ N \t),t G Z} and satisfying < a < 1 almost surely (a.s.). The limit 
aggregated process {X(t),t G Z} is defined as the limit in distribution: 

N 

^fdd m- (i.3) 

i=l 

Here and below, — >d and — >Md denote the weak convergence of distributions and finite-dimensional distribu- 
tions, respectively. A particular case of ([IIQ-dO]) corresponding to e( N \t) = iY" 1 / 2 C(t), where {((t),t G Z} 
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are i.i.d. r.v.'s with zero mean and finite variance, leads to the classical aggregation scheme of Robinson 
(1978), Granger (1980) and a Gaussian limit process {X(t)}. See also Goncalves and Gourieroux (1988), 
Zaffaroni (2004), Oppenheim and Viano (2004), Celov et al. (2007), Beran et al. (2010) on aggregation of 
more general time series models with finite variance. Puplinskaite and Surgailis (2009, 2010) discussed ag- 
gregation of random-coefficient AR(1) processes with infinite variance and innovations e^ N \t) = ^^((t), 
where {((t),t E Z} are i.i.d. r.v.'s in the domain of attraction of a— stable law W, < a < 2. Aggregation 
and disaggregation of autoregressive random fields was discussed in Lavancier (2005, 2011), Lavancier et al. 
(2012), Puplinskaite and Surgailis (2012), Leonenko et al. (2013). 

The present paper discusses the existence and properties of the limit process {£(£)} in the general triangular 
aggregation scheme (jl.ip - ([1.3j) . Let us describe our main results. Theorem 12.61 (Sec. 2) says that under 
condition (jl.2p and some mild additional conditions, the limit process in (|1.3|) exists and is written as a 
stochastic integral 

£(t) := V / x*~ s M s (dx), t E Z, (1.4) 

where {M s ,s E Z} are i.i.d. copies of an infinitely divisible (ID) random measure M on [0,1) with control 
measure $(drc) := P(a E dec) and Levy characteristics (fi, a, ir) the same as of r.v. W {M ~ W) in (|1.2|) . i.e., 
for any Borel set A C [0, 1) 

Ee i6M(A) = e *(A)V(fl) ( 0£R , (L5) 

Here and in the sequel, V{6) denotes the log-characteristic function of r.v. W: 

V{9) := logEe w = f (e Wy - 1 - i0yl(|y| < l))vr(dy) - -9 2 a 2 + Wfi, (1.6) 

where fi E M, a > and ir is a Levy measure (see sec. 2 for details). In the particular case when W is 
a— stable, < a < 2, Theorem 12.61 agrees with Puplinskaite and Surgailis (2010, Thm. 2.1). We note that 
the process {X(t)} in (jl.4p is stationary, ergodic and has ID finite-dimensional distributions. According to 
the terminology in Rajput and Rosinski (1989), (|1.4|) is called a mixed ID moving- average. 

Section 3 discusses partial sums limits and long memory properties of the aggregated process {X(t)} in 
(jl.4p under the assumption that the mixing distribution $ has a probability density (f) varying regularly at 
x = 1 with exponent /3 > 0: 

cp{x) ~ C(l-xf, x-> 1 (1.7) 

for some C > 0. (jl.7p is similar to the assumptions on the mixing distribution in Granger (1980), Zaffaroni 
(2004) and other papers. In the finite variance case o^y := Y&r{W) < oo the aggregated process in (jl.4p is 
covariance stationary provided E(l — a 2 )" 1 < oo, with covariance 

r(t) := Cov(X(t),X(0)) = a 2 w E[ ^ a^a^] = ^Ef^-^] (1.8) 

s<0 

depending on cr 2 ^ and the mixing distribution only. It is well-known that for < /3 < 1 (II. 7|) implies that 
r(t) ~ Cit~P (t — > oo) with some Ci > 0, in other words, the aggregated process {£(£)} has nonsummable 
covariances ^tez l r (*)l = °°> or covariance long memory. 

Long memory is often characterized by the limit behavior of partial sums. According to Cox (1984), 
a stationary process {Y t ,t E Z} is said to have distributional long memory if there exist some constants 
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A n — y oo (n — ^ oo) and B n and a (nontrivial) stochastic process {J(r),r > 0} with dependent increments 
such that 

[nr] 

A-^^t-Bn) -Had J(r). (1.9) 
t=i 

In the case when {J{t)} in (jl.9p has independent increments, the corresponding process S Z} is said 

to have distributional short memory. 

The main result of Sec. 3 is Theorem 13.11 which shows that under conditions (|1.7|) and ~EW 2 < oo, partial 
sums of the aggregated {3C(t)} in (jl.4p may exhibit four different limit behaviors, depending on parameters 
f3,o~ and the behavior of the Levy measure ir at the origin. Write W ~ IDiip, 7r) if EVF = 0, EW 2 = 
a 2 + J K x 2 7r(dx) < oo, in which case V(6) of (jl.6p can be written as 

y(0) = /" (e^w - 1 - i0y)7r(dy) - \e 2 a 2 . (1.10) 

The Levy measure ir is completely determined by two nonincreasing functions n + (x) := tt({u > x}), U~(x) := 
ft{{u < —x}), x > on M + = (0, oo). Assume that there exist a > and > 0, c + + c~ > such that 

lim x Q n+(2;) = c + , lim x Q n _ (x) = c~. (1.11) 

x— s-0 x— »0 

Under these assumptions, the four limit behaviors of 5" n (r) := X/i=i correspond to the following param- 
eter regions: 

(i) < £ < 1, a > 0, 

(ii) < < 1, a = 0, l + /3<a<2, 

(iii) < p < 1, cr = 0, 0<a<l + /3, 

(iv) /3 > 1. 

According to Theorem 13. H the limit process of {^(t)}, in the sense of fjl .9|) with B n = and suitably 
growing A n in respective cases (i) - (iv) is a 

(i) fractional Brownian motion with parameter H = 1 — (/3/2), 

(ii) q— stable self-similar process A Q « with dependent increments and self-similarity parameter H = 1 — 

(/3/a), defined in fl32D below, 

(iii) (1 + 0)— stable Levy process with independent increments, 

(iv) Brownian motion. 

See Theorem 13.11 for precise formulations. Accordingly, the process {X(t)} in (II. 4h has distributional long 
memory in cases (i) and (ii) and distributional short memory in case (iii). At the same time, {3C(t)} has 
covariance long memory in all three cases (i)-(iii). Case (iv) corresponds to distributional and covariance short 
memory. As a increases from to 2, the Levy measure in (jl.lip increases its "mass" near the origin, the 
limiting case a = 2 corresponding to a > or a positive "mass" at 0. We see from (i)-(ii) that distributional 
long memory is related to a being large enough, or small jumps of the random measure M having sufficient 
high intensity. Note that the critical exponent a = 1 + f3 separating the long and short memory "regimes" in 
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(ii) and (iii) decreases with j3, which is quite natural since smaller (3 means the mixing distribution putting 
more weight near the unit root a = 1. 

Since aggregation leads to a natural loss of information about aggregated "micro" series, an important 
statistical problem arises to recover the lost information from the observed sample of the aggregated process. 
In the context of the AR(1) aggregation scheme (|l.ip - (|1.3p this leads to the so-called the disaggregation 
problem, or reconstruction of the mixing density 4>(x) from observed sample ■ ■ ■ , 3L(n) of the aggregated 
process in (jl.4p . For Gaussian process (|1.4p . the disaggregation problem was investigated in Leipus et al. 
(2006) and Celov et al. (2010), who constructed an estimator of the mixing density based on its expansion 
in an orthogonal polynomial basis. In Sec. 4 we extend the results in Leipus et al. (2006) to the case when 
the aggregated process is a mixed ID moving-average of (jl.4p with finite 4th moment and obtain the weak 
consistency of the mixture density estimator in a suitable L2— space (Theorem 14. ip . 

The results of our paper could be developed in several directions. We expect that Theorem 13.11 can be 
extended to the aggregation scheme with common innovations and to infinite variance ID moving-averages 
of (|1.4p . generalizing the results in Puplinskaite and Surgailis (2009, 2010). An interesting open problem is 
generalizing Theorem l3.1l to the random field set-up of Lavancier (2010) and Puplinskaite and Surgailis (2012). 

In what follows, C stands for a positive constant whose precise value is unimportant and which may change 
from line to line. 



2 Existence of the limiting aggregated process 

Consider random-coefficient AR(1) equation 

X(t) = aX(t-l)+e(t), teZ, (2.1) 

where {e(t),t G Z} are i.i.d. r.v.'s with generic distribution e, and a G [0,1) is a random coefficient in- 
dependent of {e(t),t G Z}. The following proposition is easy. See, e.g. Brandt (1986), Puplinskaite and 
Surgailis (2009). 

Proposition 2.1 Assume that E|e| p < 00 for some < p < 2 and Ee = (p > 1). Then there exists a 
unique strictly stationary solution to the AR(1) equation \2. 1}) given by the series 

00 

X(t) = ^a k e{t-k). (2.2) 

k=0 

The series in \2. 2]) converge conditionally a.s. and in L p for a.e. a G [0, 1). Moreover, if 

< 00 (2.3) 



E 



LI - a 

then the series in \2.2\) converges unconditionally in L p . 

Write W ~ ID(fx, a, ir) if r.v. W is infinitely divisible having the log-characteristic function in (|1.6p . where 
fM G K, a > and tt is a measure on R satisfying 7r({0}) = and J R (x 2 A l)7r(da;) < 00, called the Levy 
measure of W. It is well-known that the distribution of W is completely determined by the (characteristic) 
triplet (fj,, a, ii) and vice versa. See, e.g., Sato (1999). 
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Definition 2.2 Let {e^ N ' , N G N*} be a sequence of r. v. 's tending to in probability, andW ~ ID(fi,a,7r) be 
an ID r.v. We say that the sequence {e^} belongs to the domain of attraction ofW, denoted {e^} G D(W), 
if 

(C N (9)) N -> Ee w , VfleR, (2.4) 
where Cn{9) '■= Eexp{i9e( N '}, 6* G R, is the characteristic function of e^. 

Remark 2.1 Sufficient and necessary conditions for {eW} G in terms of the distribution functions 

of e( N ' are well-known. See, e.g., Sato (1999), Feller (1966, vol. 2, Ch. 17). In particular, these conditions 
include the convergences 

NP(e {N) > x) -> II + (x), iVP(e (Ar) < -a) -> IT" (a;) (2.5) 

at each continuity point x > of H" + , II - , respectively, where il 1 * 1 are defined as in (jl.lip . 

Remark 2.2 By taking logarithms of both sides, condition (|2.4p can be rewritten as 

NlogC N {9) -> logEe iew/ = V(0), V^Gffi, (2.6) 

with the convention that the l.h.s. of (|2.6j) is defined for iV > Nq(9) sufficiently large only, since for a fixed 
iV, the characteristic function Cn{9) may vanish at some points 8. In the general case, (|2.6|) can be precised 
as follows: For any e > and any if > there exists Nq(K, e) £ N* such that 

sup |iVlogC7v(#) < e, ViV > iV (#,e). (2.7) 

|0|<if 

The following definitions introduce some technical conditions, in addition to {e^} G D(W), needed to 
prove the convergence towards the aggregated process in (|1.3jl . 

Definition 2.3 Lei < a < 2 and {eW} &e a sequence of r.v.'s. Write {eW} G T(a) i/ i/iere exists a 
constant C independent of N and x and such that one of the two following conditions hold: either 

(i) a = 2 and EeW = 0, i\fE(e^) 2 < C, or 

(ii) < a < 2 and iVP(|eW| > x) < Ci"", x > 0; moreover, EeW = whenever 1 < a < 2, while, for 
a = 1 we assume that the distribution of is symmetric. 

Definition 2.4 Let < a < 2 and VF ~ ID(fi,o~,ir). Write W G 7~(a) i/ i/iere exists a constant C 
independent of x and such that one of the two following conditions hold: either 

(i) a = 2 and EW = 0, EW 2 < oo, or 

(ii) < a < 2 and II + (x) + IT - (x) < Cx~ a , Vi > 0; moreover, EW = whenever 1 < a < 2, while, for 
a = 1 we assume that the distribution of W is symmetric. 

Corollary 2.5 Let {e^} G D(W), W ~ ID(p,,a,ir). Assume that {e (7V) } G T(a) for some < a < 2. 
Then W G T(a). 
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Proof. Let a = 2 and R N denote the l.h.s. of ([L"5]) . Then i?^ W 2 and EW 2 < lim inf jv-kk, Ei?^ = 
lim inf jv^oo N'E(e^ N " 1 ) 2 < oo follows by Fatou's lemma. Then, relation ~EW = limN-s-oo E-Rat = follows by 
the dominated convergence theorem. For < a < 2, relation n ± (x) < Cx~ a at each continuity point x of 
II ^ follows from {eW} G and ()2.5[) and then extends to all x > by monotonicity. Verification of the 

remaining properties of W in the cases 1 < a < 2 and a = 1 is easy and is omitted. □ 

The main result of this section is the following theorem. Recall that {Xi(t) = X[ f (i)}, i = 1, 2, • • • , N are 
independent copies of AR(1) process in (|2.ip with i.i.d. innovations {e(t) = e^ N \t)} and random coefficient 
a 6 [0, 1). Write M ~ if M is an ID random measure on [0, 1) with characteristic function as in (|1.5|) - (|1.6|) , 

Theorem 2.6 Let condition \2. 3\) hold. In addition, assume that the generic sequence {e^} belongs to the 
domain of attraction of ID r.v. W ~ ID(n,a,ir) and there exists an < a < 2 such that {e^ N '} E T(a). 
Then the limiting aggregated process {X(t)} in U.3\) exists. It is stationary, ergodic, has infinitely divisible 
finite- dimensional distributions, and a stochastic integral representation as in where M ~ W . 

Proof. We follow the proof of Theorem 2.1 in Puplinskaite and Surgailis (2010). Fix m > 1 and 0(1), • • • , 9(m) G 
M. Denote 

m 

${s,a) :=Y,°(tW' s Hs < t). 
t=i 

Then YTtUmxf^t) = £ seZ tf(^h (A °(*). i = 1, - ■ ■ >N, and 

Eexp{i£J>)^(t)} = ( E exp{i£*(f)xW(f)}) = (l + W) , (2.8) 

i=l t=l t=l 

where 



Q(N) := Jv(e[JJCjvW*.o)) 
From definitions ()1.4|) . (jl.6p it follows that 

m 

Eexp{ij^0(t)£(t)} = e e , where 9 := E^ V(ti(s, a)). (2.9) 



t=i 



The convergence in (|1.3p to the aggregated process of (|1.4j) follows from (|2.8p . (|2.9p and the limit 

lim env) = e, (2.10) 

N— >oo 

which will be proved below. 

Note first that sup ag [ 01 ) sgZ a)| < J2tLi 1^(01 =: ^ i s bounded and therefore the logarithm logCjv(??(,s, a)) 
is well-defined for N > Nq(K) large enough, see (|2.7p . and 0(iV) can be rewritten as 



0(iV) = EJv(exp{w -1 J^iVlogCjv(0(s,a))} - l). 



Then (|2.10p follows if we show that for each a £ [0, 1), 



lim V iVlogC7v(tf(s,a)) = Vo€[0,l) (2.11) 



iV-j-oo 



6 



and 

J2\NlogC N {0(s,a))\ < — VaG [0,1), (2.12) 
— ' 1 1 1 — a" 

where C does not depend on N,a. 

Let us prove (|2.12p . It suffices to check the bound 

N\1-C N (9)\ < C\9\ a . (2.13) 

Indeed, since |C/v($(s, a)) — 1| < e for N large enough (see above), so |7VlogCAr(tf(,s, a))\ < CN\l - 
Cat(i?(s, a)) I and (|2.13|) implies 

Y,\NlogC N ($(s,a))\ < CY,\Hs,a)\ a < (2.14) 

s&Z s£Z 

see Puplinskaite and Surgailis (2010, (A.4)), proving (|2.12p . 

Consider (I2TT3I) for 1< a < 2. Since EeW = so C Ar (6») - 1 = J R (e Wx - 1 - Wx)dF N (x) and 

/0 poo 
(e [0x - 1 - Wx)dF N (x)\ +N\ (e i9x - 1 - i0x)d(l - i^(x))| 
-oo Jo 
f-0 /-co 



1/ NF N (x)(e i6x - l)dx\ + | / iV(l-Fjv(x))(e iftE -l)da;| 

V-00 JO 
/■oo 

< C|0| / x~ a ((|#|:z;) A l)dx < C\9\ a , (2.15) 
Jo 

since NF N (x)l(x < 0) + iV(l - F N (x))l(x > 0) < C|x|" a and the integral 

x~ a ((\e\x) A l)da = \9\ [ ' ' x l ~ a dx + I x~ a dx = |0| Q_1 (— !— + 



o Ji/\e\ 2 - « a- 1 

converges. In the case a = 2, we have N\C N {6) - 1| < -^iVE^W) 2 < C6> 2 and (pJ3|) follows. 
Next, let < a < 1. Then 

/0 />oo 

|e ife - l\dF N (x) + AT / |e ife - 1| |d(l - F N (x))\ =: I x + I 2 . 
-oo Jo 

Here, 7i < 2iV \x\) A l)dFjv(x) = 2N fZ^W di^rr) + 2iV]0] |x|dFjv(x) =: 2(/ n + 7 12 ). We 
have In = iVi^VC— 1/|^|) < C|#| a and 

/•O _ pO 

hi = -\B\N J ^ xdF N (x) = -\9\N[xF N (x)\ x x Z°_ im - J F N (x)dxj 

F N (-i/\e\) 



= w(-w$m + r F Nix) dx) 

< c\e\ a + c\e\ f \x\~ a dx < c\e\ a . 

J-i/\e\ 

Since I 2 can be evaluated analogously, this proves (|2.13p for < a < 1. 

It remains to prove (|2. 13[) for a = 1. Since f^^^^ xdFiy(x) = by symmetry of eW, so C N {6) - 1 = 

Ji + h + h + Ja, where J x := JT^ 1 (e ite - l)dFjv(x), J 2 := £ m (e ite - 1 - Wx)dF N (x), J 3 := J V|e| (e ife - 
1 - i6x)dF N (x), J 4 := fu\9\(. eWx ~ l)dF N (x). We have JV|Ji| < 2NF N (-l/\6\) < C\9\ and a similar bound 
follows for Ji,i = 2,3,4. This proves (|2.13p . Then (|2.1ip and the remaining proof of (|2.10p and Theorem 12.61 
follow as in Puplinskaite and Surgailis (2010, proof of Thm. 2.1). □ 

Theorem 12.61 applies in the case of innovations in the domain of attraction of a— stable law, see below. 



7 



Definition 2.7 Let < a < 2 and Q be a r.v. Write ( £ D(a) if 

(i) a = 2 and E( = 0, E( 2 < oo, or 

(ii) < a < 2 and there exist some constants c±, c 2 > 0, ci + c 2 > suc/i t/iai 

lim x Q P(C > x) = ci and lim |x|°P(C < x) = C2; 
moreover, E£ = whenever 1 < a < 2, while, for a = 1 we assume that the distribution of £ is symmetric. 

Corollary 2.8 Let eW = N'^C, where ( G < a < 2. T/ien {gW} G T(a) and {e^} E £>(W), 

where W is a— stable r.v. with the characteristic function 



where 



uj(6;a,ci,c 2 ) ■= < 



((ci + c 2 ) cos(7ra/2) - i(ci - c 2 )sign(6>) sin(7ra/2)) , a / 1, 2, 
(ci+c 2 )(7r/2), a = l, (2.17) 

a 2 /2, a = 2. 



In i/iis case, i/ie statement of Theorem \2.6\ coincides with Puplinskaite and Surgailis (2010, Thm. 2.1). 

3 Long memory properties of the aggregated process 

In this section we study partial sums limits and distributional long memory property of the aggregated mixed 
ID moving-average in (|1.4j) under condition (jl.7j) on the mixing density (p. More precisely, we shall assume 
that (ft has the form 

<(>{x) = ip(x) (1 - xf, xe(0,l), (3.1) 

where (3 > and ip(x) is an bounded function having a finite limit ip{\.) : = lim^-j.! ip(x) > 0. 

Consider an independently scattered a— stable random measure N(dx, ds) on (0, 00) x M. with control 
measure v(dx,ds) := ip(l)x l3 ~ a dxds and characteristic function Ee l6W( ^ = e -\ e \ au] {8;a,c + ,c )v(A)^q ^ ^ 
where A C (0, 00) x R is a Borel set with v(A) < 00 and oj is defined at (|2.17p . For 1 < a < 2, < (3 < a-1, 
introduce the process 



A Qi/3 (r) := / _(f{x,T-s)-f{x,-s))N(dx,ds), r > 0, where (3.2) 
f(x,t) := 



1 - e xt , if x > and t > 0, 
0, otherwise 



defined as a stochastic integral with respect to the above random measure N. The process A a ^ was introduced 
in Puplinskaite and Surgailis (2010). It has stationary increments, a— stable finite-dimensional distributions, 
a.s. continuous sample paths and is self-similar with parameter H = 1 — £ e (— , 1). Note that for a = 2, 
A 2i /3 is a fractional Brownian motion. Write —>d[o,i] f° r the weak convergence of random processes in the 
Skorohod space D[0, 1] endowed with the J\— topology. 
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Theorem 3.1 Let {X(t)} be the aggregated process in {TT^Jj, where M ~ W ~ ID2(o~,tt) and the mixing 
distribution satisfies (|3.ip . 

(i) Let0</3<1 and a > 0. Then 

[nr] 

-+ D[0>1] B H (r), (3.3) 

n 2 t=i 

where Bh is a fractional Brownian motion with parameter H := 1 — f and variance ~EB h (t) = a 2 ip(l)T(f3 — 
2)t 2H . 

(ii) Let 0</3<l, <r = and i/iere exisi 1 + j3 < a < 2 and c > 0, c + + c~ > swc/i t/iat hold. Then 

[nr] 

— jJ2 x( fi ^mi] A ^( r )> ( 3 - 4 ) 

n <* t=l 

where A Q a is defined in h3.2\ ). 

(in) Let < /? < 1, <r = 0, ir ^ and there exists < a < 1 + (3 such that 



[ |x| a vr(dx) < oo. (3.5) 
Jr 



Then 

[nr] 

^ fdd L 1+/3( T )' ( 3 - 6 ) 

n^+P t =l 

where {Li + /3(t),t > 0} is an (1 + B) — stable Levy process with log- characteristic function given in \3. 22\) 
below. 

(iv) Let /3 > 1. Then 

[nr] 

— ^X(t) -+ m a$B(r), (3.7) 

where B is a standard Brownian motion with El? 2 (l) = 1 and <r$ is defined in \3.23\) below. Moreover, if 
f3 > 2 and 7r satisfies \3. 5\) with a = 4, i/ie convergence — s-fdd * n 7| ) can 6e replaced by -^d[o,i]- 

Remark 3.1 Note that the normalization exponents in Theorem 13.11 decrease from (i) to (iv): 

B 8 11 

l ~2 > l ~a > T+p > 2" 

Hence, we may conclude that the dependence in the aggregated process decreases from (i) to (iv). Also note 
that while {X(t)} has finite variance in all cases (i) - (iv), the limit of its partial sums may have infinite 
variance as it happens in (ii) and (iii). Apparently, the finite-dimensional convergence in (|3.6p cannot be 
replaced by the convergence in D[Q, 1] with the J\— topology. See Mikosch et al. (2002, p. 40), Leipus and 
Surgailis (2003, Remark 4.1) for related discussion. 

Proof, (i) The statement is true if tt = 0, or W ~ A/"(0, a 2 ). In the case ir ^ 0, split X(t) = Xi(t) + ^(t), 
where X\ (t) , Xi (t) are defined following the decomposition of the measure M = Mi + M^ into independent 
random measures M\ ~ W\ ~ LD2(cr, 0) and M2 ~ W2 ~ /^(0, 7r). Let us prove that 



'n2 • — 

t=l 



X> 2 (i) = o p {n 1 ^). (3.8) 
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Let V 2 {6) := logEe ievy2 = f R {e Wx - 1 - iOx)ir(&x). Then 

\V 2 (6)\ < C6 2 (VflGl) and \V 2 {0)\ = o(9 2 ) (\0\ -)• oo). (3.9) 

Indeed, for any e > 0, |F 2 (0)| < 6 2 h(e) + 2|0|J 3 (e), where h(e) := #" 2 /. .< Je i6x - 1 - iBx\n(dx) < 
f lxl<e x 2 7r(dx) -> (e -> 0) and J 2 (e) := (2| ^| )~ 1 L, >e |e ite - 1 - i0a;|7r(daj) < f~ £ |x|7r(da;) < oo (Ve > 0). 
Hence, (13.91) follows. 



Relation f|3.8j) follows from J n := logEexp {iOn 1+ 2 SV^} = o(l). We have 

fi n 

Jn = V 2 {en~ l+ ^ 2 Y,^-Z) t - S l{t>s))z^{l-Z)dz = j nl + Jn2, 

sez ^° t=l 

where J n \ := Y. s <o Jo ' ' )^i>{^ — z)dz, J n 2 := S"=i Jo 1 ' ) Z ^4>{1 - z)dz. By change of variables: 
nz = w, n — s + 1 = nu, J n2 can be rewritten as 



s=l 



j_ /' d „ rw^c-c-g"))^/.,;),, 

nP Ji/n Jo v ^ J \ nJ 

du G n {u,w)w p - 2 ^(l - -Jdw, 



where 

G„(u,u;) := (1 - (1 - ^)M) 2 K f gw/3/2(1 ~ (1 ~ lQ )l(l/n < M < 1,0 < w < n) 

and where k(9) := V 2 (9)/8 2 is a bounded function vanishing as \9\ — > oo; see (|3.9p . Therefore G n (u,w) — > 
0(n^ oo) for any u G (0,1], w > fixed. We also have \G n (u,w)\ < C(l - (1 - ^)M) 2 < c{l-e~ wu ) 2 =: 
G(u,w), where du J °° G(u, w)w l3 ~ 2 dw < oo. Thus, J n2 = o(l) follows by the dominated convergence 
theorem. The proof J n \ = o(l) using (|3.9p follows by a similar argument. This proves J n = o(l), or (|3.8p . 
The tightness of the partial sums process in D[0, 1] follows from /3 < 1 and Kolmogorov's criterion since 
E( ^™ =1 jC(t)) 2 = 0(n 2 ~^), the last relation being an easy consequence of r(i) = 0(i - ^), see (jl.8p and the 
discussion below it. 

(ii) Let 5„(r) := Yluli Let us P rove that for any < t± < ■ ■ ■ < T m < 1, 0\ ER, ■ ■ ■ ,0 m e R 



J n := logEexp |i - p- ^2djS n (rj)\ ->■ J, where (3.10) 
n 1 " j=1 

r m a m d d 

J : = j( f (w, Tj -u) - f(w,-u)) lo( y20j(f(w,Tj - u) - f(w,-u));a,c + ,c~) — — j. 

We have J = log Ee 1 ^ 1 ^V^fa) by definition ((321) of A a>j9 . We shall restrict the proof of ([330]) to 
m = ri = 1, since the general case follows analogously. Let V(0) be defined as in (jl.lOp . where a = 0. Then, 



j n = E/ n J T7E( 1_ ') hl ^ , ))^ 1 - , ) di 

sgz^o V t=i 7 

= T V(...)z^(l - z)dz + E f V(...)z^(l - z)dz + J2 t V(...)z^(l - z)dz 

s <0 ^° 8=1 ^° s&L ^ 



Jnl + Jn2 + «/n3; 
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Similarly, split J = J\ + J2, where 

du / (/(«;, 1 - u) - f(w, -u)) a w p - a dw, 
-00 Jo 

rl poo 

j 2 ■- -\e\ a ip(l)u;(e; a, c + ,c~) du (f(w,u)) a w^ a dw. 

Jo Jo 

To prove (|3.10p we need to show J n \ — > J\, J n 2 — > J2, J n 3 — > 0. We shall use the following facts: 

lim XV(X' 1/a 6) = -\9\ a Lj(8;a,c + ,c-), Vflel (3.11) 

A^+0 V ; 

and 

\V(0)\ < C\6\ a , V«eR (3C<oo). (3.12) 

Here, ()3. 12[) follows from (jl.lip . f R x 2 7r(dx) < 00 and integration by parts. To show ()3.1ip . let \{ x )i x £ K be 
a bounded continuously differentiable function with compact support and such that x( x ) = 1? \ x \ < 1- Then 
the l.h.s. of (13. lip can be rewritten as 



XV(X~ 1 ^ a 9) = / (e^ - 1 - iOyx(v))*x(dy) + i6^ x , 

where w\(dy) := Xir(dX 1 ^ a y), u x> \ := Ly(x(y) — l)it\(dy). The r.h.s. of (|3. 11 [) can be rewritten as 
-\0\ a u(O;a,c+,c-) = V o (0) := / a (e*» - 1 - WyxWiroW + ^x,o, 

where vr (dy) := -c + dy~ a l(y > 0) + c~d(-y)~ Q l(y < 0), u xfi := f R y{x(y) ~ ^o{dy). Let Q, be the class 
of all bounded continuous functions on M. vanishing in a neighborhood of 0. According to Sato (1999, Thm. 
8.7), relation (|3.1ip follows from 



A->0 



lim / /(y)7r A (dy) = f(y)n (dy), V/eC t , (3.13) 



J im ,Mx,A = Vhc,o, lim !™, / V 2 ' K \{dy) = 0. (3.14) 

A— >0 e\0 A— >0 J\y\< t 



Relations (|3.13j) is immediate from (jl.lip while (|3.14p follows from (jl.lip by integration by parts. 

Coming back to the proof of (|3.10p . consider the convergence J n 2 — > Ji- By change of variables: nz 
w,n — s + 1 = nu, J n 2 can be rewritten as 



-PV(6n« i rtl 

v w 

= -\9\ a uj(9;a,c + ,c~) du (- — ) n n 2{9; u, w)w )3 ip( 1 — —~)dw, 

Jo Jo v w / \ nJ 

where n n 2(u,w) is written as 



Jn2 = I du I n~ p V[9n«- - rtl )w p i>(l--)dw 

'l/n Jo V 

POO g— WU s 



rl _ e - W u V(6n^w-\1-{1-^)) 

K n2 (0;u,w) := - n p ^ — — y -l(n < u < 1, < w < era) 

\ w J \9\ a Lo{9; a, c+, c ) 

xv(x~ 1 / a 9) / 1 - (1 - ^) [un] \ <* 

4 — d — T ) <^< l,0<«;<€n) (3.15) 

\ a oj {9;a,c + ,c~ V 1 - e~ wu J y ~ ' ; y J 
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with 

A = X n (u.w) := n p [ —, — T ) -)■ 

ny ' ; Vi - (i - h)M7 

for each u G (0,1], to > fixed. Hence and with (|3.1ip in mind, it follows that K n 2(6;u,w) — > 1 for each 
6 G R, u G (0,1], w; > and therefore the convergence J n 2 —> J2 by the dominated convergence theorem 
provided we establish a dominating bound 

\K n2 (e;u,w)\ < C (3.16) 

with C independent of n, u G (0, 1], iu G (0, en). From (|3.12p it follows that the first ratio on the r.h.s. of ()3. 15[) 
is bounded by an absolute constant. Next, for any < x < 1/2, s>0we have 1 — x > e~ 2x (1 — x) s > 
e -2xs ^ l-(l- x )'< 2(1 - e~ xs ) and hence \_ e -L < ^-"1 < 2 for any < w < n/2, u > so 
that the second ratio on the r.h.s. of (|3.15j) is also bounded by 2, provided e < 1/2. This proves ()3. 16|) and 
concludes the proof of J n 2 —> The proof of the convergence J n \ — > J\ is similar and is omitted. Using 
inequality (|3.12p it is not difficult to prove that | J n ^\ < . Since /3 — (a — 1) < 0, J n 3 — > 0. This 

concludes the proof of (I3.10p , or finite-dimensional convergence in (I3.4D . 

To prove the tightness part of (|3.4h . it suffices to verify the well-known criterion in Billingsley (1968, 
Thm.12.3): there exists C > such that, for any n > 1 and 0<t<t + /i<1 

supu a P(n^- 1 \S n (T + h)- S n (T)\>u) < Ch a -\ (3.17) 

u>0 

where a — j3 > 1. By stationarity of increments of {3i(t)} it suffices to prove (|3.17p for r = 0, h = 1, in which 
case it becomes 

supu a P(\S n \>u) < Cn a ~P, S n :=S n {l). (3.18) 

The proof of (|3.18p . below, requires inequality in (|3.19p for tail probabilities of stochastic integrals w.r.t. 
ID random measure. Let L Q (Z x (0,1)) be the class of measurable functions g : Z x (0,1) — > R with 
\\g\\a := Ssez E|<?(s, a )\ a < 00 • Also, introduce the weak space L^(Z x (0,1)) of measurable functions 
g : Z x (0, 1) -> M with || 5 ||° w := sup 4>0 ^ E se z p (l<?(s, o)| > t) < 00. Note L a (Z x (0, 1)) C L%(Z x (0, 1)) 
and HsIIq^ < \\g\\a- Let {M s ,s G Z} be the random measure in (|1.4|) . M ~ W ~ ID2(0, vr) with zero mean 
and the Levy measure 7r satisfying the assumptions in (ii). It is well-known (see, e.g., Surgailis (1981)) that 
the stochastic integral M(g) := Yls&z I(o 1) #( s ' o,)M s (da) is well-defined for any g G L P (Z x (0,1)), p = 1,2 
and satisfies EM 2 (g) = C2 1 1 1 1 2 ' E|M(#)| < Ci||g||i for some constants C>i,C>2 > 0. The above facts together 
with Hunt's interpolation theorem, see Reed and Simon (1975, Theorem IX. 19) imply that M{g) extends to 
all g G L®(Z x (0, 1)), 1 < a < 2 and satisfies the bound 

supu Q P(|M( 5 )| >u) < C\\g\\^ w < C\\g\\ a a , (3.19) 
«>o 

with some constant C > depending on a, Ci, C2 only. Using (|3.19|) and the representation S n = M{g) with 
g(s,a) = Ym=i «* _s l(i > s) we obtain 

n 

supn°P(|5 n | > u) < C^E(^a'- s ) a = OK"^), 

where the last relation is proved in Puplinskaite and Surgailis (2010, proof of Theorem 3.1). This proves 
flgZEgD and part (ii). 
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(iii) It suffices to prove that for any < n < • • • < r m < 1, Q\ G M, • • • ,fl m GR 

J n := logEexp{i +g) ^^(r,-)} J := logEexp{i^%L 1+ ^(r,)}. (3.20) 



Similarly as in (i)-(ii), we shall restrict the proof of ()3,20p to the case m = 1 since the general case follows 
analogously. Then 

Jn = J2 v(n~ 1 ^ + Ve^2(l-z) t - s l(t>s))z^(l-z)dz = J nl + J n2 , 

sGZ ^° t=l 

where J„i := £ s < fo V{- • • )z^(l - z)dz, J n2 := EH ^ F ( - ' " )*^(! - ^) d ^- Let # > 0. By the change of 
variables: n^/^^z = 6/y, [nr] — s + 1 = nu, J n2 can be rewritten as 

^ - gjfv r-^r> «,-*, 

/„ ^(^-c-st^^O^-s^!;) 1 -** 1 "'- (3 ' 21) 

where l„(6»;y,n) := l(l/n < it < [nr]/n],y > fln" 1 /^)) _». 1(0 < u < r,y > 0). As (1 - nl/ ° +/3) ) un -> 
for any u,y > due to n/n 1 ^ 1 " 1 "^ — >■ oo, we see that the integrand in (|3.2ip tends to y~P~ 2 V(y)ij)(V). We 
will soon prove that this passage to the limit under the sign of the integral in (|3.2ip is legitimate. Therefore, 



poo 

du 







pOO 

Jn2 -> J := r|0| 1+ ^(l) y y(y)y-^- 2 dy = -r|0| 1+/ V(l 1 + /3, vr", vr+), 



(3.22) 



oo i /-0 

x 1+/3 vr(dx), ttJ := — !-r / |x| 1+/3 ^(dx), 



/» - 1 + /3 y o - «v-;, «/, ■ 1 + /3 



and the last equality in (|3.22p follows from the definition of V(y) and Ibragimov and Linnik (1971, Thm. 
2.2.2). 

For justification of the above passage to the limit, note that the function V{y) = f^(e iyx — 1 — iyx)ir(dx) 
satisfies \V{y)\ < V 1 {y) + V 2 {y), where Vi(y) := y 2 f\ x \< 1/M x 2 ir(dx), V 2 (y) := 2\y\ f\ x \ >1/M |s|7r(dx). We have 

poo p pl/\x\ p poo 

/ {Vi{y) + V 2 {y))y-P- 2 dy < x 2 ir(dx) y^dy + 2 / |x|ir(dx) / y^dy 

Jo Jo Jk Ji/\x\ 

< C [ \x\ l+ ^(dx) < oo. 

JR 

Next, sup 1/2 < c <i Vi(cy) < y 2 j\ x \< 2/ \ y \X 2 Ti{dx) =: Vi(y), sup 1/2 < c <i V 2 (cy) < V 2 {y) and / °° Vi{y)y~^~ 2 dy < 
oo. Denote ( n (9;y,u) := (1 — n i/(i+p)y )^ un ^- Then ( n (9;y,u) > and we split the integral in (|3.2ip into two 
parts corresponding to Q n {6;y,u) < 1/2 and Q n {6;y,u) > 1/2, viz., J n2 = J+ 2 + J~ 2 , where 



J, 



n2 



1+p j du j y^- 2 dyV(y{l - ( n (9; y, u))^(l - ) HCn(9; y, u) < l/2)l w (fl, y, u), 



oo 

1+/3 



J" 2 := 0^ / du 



y-P- 2 dyV (y(l - ( n (6; y, u)))^(l - nl/(1 +^ ) l(Cn(0; y, «) > l/2)l n (0; y, «). 



Since |V(y(l — C n (9;y,u)))l(C n (9;y,u) < 1/2) | < Vi(y) + V^(y) is bounded by integrable function (see 
above), so J^ 2 — > J by the dominated convergence theorem. It remains to prove J~ 2 — > 0. From inequalities 
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1 - x < e~ x (x > 0) and [un] > un/2 (u > l/n) it follows that ( n (6;y,u) < e -"W2« 1/(1+ ' ?) y an d hence 
l(( n (9;y,u) > 1/2) < i( e -«»/2« 1/(1+ «j > y 2 ) = l((u/y) < cm" 7 ), where 7 := /3/(l + /3) > 0, c x := 
(21og2)/0. Without loss of generality, we can assume that l<a<l + /3in (|3.5p . Condition (|3.5p implies 

|V(l/)| < / \yx\ a ir(dx) +2 / M^dx) < VyGM. 



Hence 



|J- 2 | < C f du /■ 00 l(H< Cl „-7) < Kn-7(i^-«) ^ 

where K := C Jq t/* _1_/3 dii < 00. This proves J n 2 — > J, or (|3.22p . The proof of J n \ — > follows similarly 
and hence is omitted. 

(iv) The proof of finite-dimensional convergence is similar to Puplinskaite and Surgailis (2010, proof of Thm. 
3.1 (ii)). Below, we present the proof of the one-dimensional convergence of n" 1 / 2 ^ = n" 1 / 2 Yst=i 
towards A/"(0, a\) with <t| > given in (|3.23p below. Since the general case follows analogously. Similarly as 
above, consider J n := logEexp{i0n~ 1 / 2 5 n } = J n \ + J n2 , where J n \ '■= ^2 s <o EF(6>n _1 / 2 Ylt=i a *~ S ) > Jn2 '■= 
E"=i EF^n-V 2 J2?=s We have 



^ = E/ (1 i/ 2 Z) )^-^ 

= -tfV^n-iV/ (i-(i-^) fc )W(^;fc^)0(i-^, 

fc=l •'o 



where K n (9;k,z) := ^(fl 1 ^17^ ) and the function := — V ^ y \ satisfies lim v _»o K {y) — 1> SU P?,£R \ K (y)\ < 
00. These facts together with /3 > 1 imply n" 1 ££=1 /^(l - (1 - z) k ) 2 z~ 2 K n (9;k, z)<f>(l - z)dz ->■ z~ 2 <j)(l- 
z)dz and hence J n 2 — >• — (l/2)(9 2 cr|, , with 

o- 2 : = 2alv [ z" 2 (f)(l - z)dz = 2a 2 v E(l - a)" 2 . (3.23) 



The proof of J n \ — > follows similarly (see Puplinskaite and Surgailis (2010) for details). This proves (13.7p . 
Let us prove the tightness part in (iv). It suffices to show the bound 

ES 4 < Cn 2 . (3.24) 

We have S n = M(g), where M is the stochastic integral discussed in the proof of (ii) above and g = g(s, a) = 
£™ = i a*- s l(t > s) G L 2 {Z x (0, 1)). Then EM 4 {g) = cum 4 (M( 9 )) + 3(EM 2 ( 5 )) 2 , where EM 2 ( 5 ) = ES 2 satis- 
fies ES 2 < Cn (the last fact follows by a similar argument as above). Hence, (EM 2 (g)) 2 < Cn 2 in agreement 
with (|3.24p . It remains to evaluate the 4th cumulant cum^S^) = cum^Af^)) = tt^ ^2 s€ % Eg 4 (s, a), where 
7T4 := f R x 4 7r(dx). Then cum^SVO = 7T4(L n i + L n 2), where 



1 ti fl 

^ ■= E E E^ s . ^ 2 : = E E (E« ] 



s<0 t=l s=l t=s 

We have 



n k g n „i 

K2 < n E E (E a *) - n E / ^i}{l-z)dz < Cn 2 

k=l t=0 k=l ^° 



14 



since ft > 2. Similarly, 

s<0 t=l ^ ' 

This proves (|3.24p and part (iv). Theorem 13. II is proved. □ 



4 Disaggregation 

Following Leipus et al. (2006), let us define an estimator of <fi, the density of the mixing distribution Its 
starting point is the equality (II, 8j) . implying 

°w( r (k)-r(k + 2)) = [ x k (t>(x)dx, k = 0,l,---, (4.1) 

J o 

where r(/c) = Cov(£(/c), 3t(0)) and <rjy = Var(VF) = r(0) — r(2). The l.h.s. of (I4.1D . hence the integrals on 
the r.h.s. of (|4.1j) . or moments of <£, can be estimated from the observed sample, leading to the problem of 
recovering the density from its moments, as explained below. 

For a given q > 0, consider a finite measure on (0,1) having density w^(x) := (1 - a;) 9-1 . Let L 2 (w M ) 
be the space of functions h : (0, 1) — > R which are square integrable with respect to this measure. Denote by 
| Jn \ n = 0, 1, • • • | the orthonormal basis in L2(w^) consisting of normalized Jacobi polynomials: 

n 

jj?\x) := $>g^, (4.2) 
i=o 

with coefficients 



M . = ( n n-, V 2 " + g T(n+1) T{q + n + j) 

y n,j ■ \ *-) r(r, + n\r(r, - n 4-1 ^ ^, + 112 ' ^■° } 



T(n + q)T(n- j + 1) T(j + 1 
< i < n. See Abramovitz and Stegun (1965, p. 774, formula 22.2.2). Thus, 



J q, (x)4 q) (x)w^(x)dx = J ; (4.4) 

J I if j i= k. 

Any function h G L2(w^) can be expanded in Jacobi's polynomials: 

oo „i k „i 

h(x) = J2h k jjf\x) with /ifc=/ h(x)jl q) (x)w( q) (x)dx = J^Sk] / Mz)^w (9) (x)dx. (4.5) 

Below, we call (|4.5p the g-Jacobi expansion of h. 
Consider the function 



Cfr) := (1 r^ZI , with jf C{x){l-xf- 1 dx = 4>{x)dx = l. 



(4.6) 



Under the condition 

0(x) 2 



o (l-^) 9 



— dx < oo, (4.7) 
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the function £ in (|4.6p belongs to Z^it/ 9 '), and has a g— Jacobi expansion with coefficients 

Cfc = E^1/ #*0^ = — E^]( r (i)-r(i + 2)), fc = o,i,---; (4-8) 

i=o ' Jo a w j=0 

see (|4.ip . Equations (|4.5p . (j4.8|) lead to the following estimates of the function ((x): 

K n K n 
Cn(x) := ^T( n ,k4 q) (x), Ux) := ^n^^), (4.9) 
fc=0 fc=0 

where K n ,n £ N* is a nondecr easing sequence tending to infinity at a rate which is discussed below, and 

Cn,k := ^rY.9k)(jn(j)-r n (j + l))i Cn,k := \- £ g§ (r„ l?) - r n (j + 2)) (4.10) 
a w j=0 ' a w i=0 

are natural estimates of the C^s in (|4.8p in the case when <r^ is unknown or known, respectively. Here and 
below, 

* := -E X W' fn(j) : =-E( X W-^)( X ( i + ^)-^)' i = 0,l,---," (4-11) 
fe=i i=l 

are the sample mean and the sample covariance, respectively, and the estimate of = r(0) — r(2) is defined 
as 

°W :=fn(0) -f„(2). 
The corresponding estimators of (j)(x) is constructed following relation (14.6P : 

n (x) := Cn(x)(l-xy-\ Mx) := Cn{x){l-xf-\ (4.12) 

The above estimators were essentially constructed in Leipus et al. (2006) and Celov et al. (2010). The 
modifications in (|4,12p differ from the original ones in the above mentioned papers by the choice of a more 
natural estimate (|4.1ip of the covariance function r(j), which allows for non-centered observations and makes 
both estimators in (|4.12p location and scale invariant. Note also that the first estimator in (|4.12p satisfies 
Jq (pn(x)dx = 1, while the second one does not have this property and can be used only if <r^ is known. 

Proposition 4.1 Let (X(t)) be an aggregated process in J 1.4\ ) with finite J^th moment EX(0) 4 < oo and 
M ~ W ~ ID(fi,a,ir). Assume that the mixing density (p(x) satisfies conditions 112. 3\) and 7[ ), with some 
q > 0. Let Cn( x ) be the estimator of Q{x) as defined in (|4.9|) . where K n satisfy 

K n = [jlogn] with < 7 < (41og(l + v^)) -1 . (4.13) 

Then 

E(Cn(x) -C(x)f{l-x) q ~ 1 dx -»• 0. (4.14) 

Proof. Denote v n the l.h.s. of (j4. 141) . From the orthonormality property (|4.4p . similarly as in Leipus et al. 
(2006, (3.3)), 

K n OO 

v n = ^E(C„, fc -Cfc) 2 + £ (I (4.15) 

k=0 k=K n +l 
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where the second sum on the r.h.s. tends to 0. By the location invariance mentioned above, w.l.g. we can 
assume below that EX(t) = 0. Let r° n (j) := ± ££i £(*)£(* < j < n, then Ef^(j) - r(j) = (j/n)r(j) 

and 

E{Cn, fc -C fc } 2 = ^{Y.^]{ ? n{3)-r n {j + 2)-T{j)+r{j + 2))) 2 

j=o 

k 

= a^E{ <?g (KU) - Kti + 2) - r(i) + r(j + 2) + 2n" 1 * 2 

j=0 

- n~ l X[X{n - j - 1) + £(n - j) + X(j + 1) + X(j + 2; 
< C^ma <X J< 7 g|) 2 X:(^ + V a r(f:0-)-^a + 2)) + ^), (4.16) 

where we used the trivial bound EX^ < C. The rest of the proof of Proposition 14. II follows from (I4.15D . (14.160 
and Lemmas 14.11 and 14.21 below. See Leipus et al. (2006, pp. 2552-2553) for details. □ 

Lemma 14.11 generalizes (Leipus et al., 2006, Lemma 4) for a non-Gaussian aggregated process with finite 
4th moment. 

Lemma 4.1 Let {X(t)} be an aggregated process in |i.^[ ) with E3E(0) 4 < oo, E3E(0) = 0. There exists a 
constant C > independent of n,k and such that 

Var(r£(fc) + 2)) <-. (4.17) 

n 

Proof. Let D(k) := X{k) - X(k + 2). Similarly as in Leipus et al. (2006, p. 2560), 

n-k-2 

\ w {r n {k)-r n {k + 2)) < Cn" 2 (Var( £ X(j)D(j + k)) + l) . 

i=i 

Here, Var( E"=f " 2 *(j W + *0) = E^Sf 2 Cov(£(i)£>(j + k),X(l)D(l + k)) , where 

Cov{X{j)D(j + k),X(l)D(l + k)) = Cum(X(j),D(j + k),X{l),D(l + k)) 

+ E[X(j)X(l)]E[D(j + k)D(l + k)) + E[X(j)D(k + l)]E[X(l)D(j + k)]. 

The two last terms in the above representation of the covariance are estimated in Leipus et al. (2006). Hence 
the lemma follows from 

n-k-2 

Cum(X(j), D(j + k), X(l), D(l + k)) < Cn. (4.18) 

3,1=1 

We have for k\, k2 > 0, 1 > j 

Cum(X(j),X(j + k 1 ),X(l),X(l + k 2 )) = ir 4 E[Y, aj ~ Saj ~ S+klal ~ Sal ~ S+k2 (l ~ a 2 ) 2 



7T 4 E r ' 



a k 1+ k 2 +2(l-j) M _ a 2\2 



and hence 

l2 fc+2(i-j)(l_ a 2) 



c jtl , k := Cum(X(j),D(j + k),X(l),D(l + k)) = tt 4 E 



1 + a^ 
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where ir^ := j R x 4 ir(dx). Then 



n—k—2 2 



E l<wl < c Y. B[Si^*w-«] 

j,l=l l<j<l<n 

< C Y E[— i-^l < Cn, 
L 1 + a 2 J 

l<j<n 

proving (|4.18p and the lemma, too. □ 

Lemma 4.2 Consider the coefficients g^- ( f-^.3| ) o/ i/te normalized Jacobi polynomial Jn^ in There 
exists a constant C q > suc/i i/iai /or a// sufficiently large n, 

G$ := max |^J.| < C 9 n 13 / 2 e nK iwtfc At := 21og(l + y/2). 

0<j<n " 

Proof is similar to Leipus et al. (2006, proof of Lemma 5). We have 



^n,n—{m+l) 



i>n,n- 



(n - z) 2 

R(m), where R(z) := -. (4.19) 

X h y ' (z + l)(g + 2n-*-l) V ; 



The roots Z-, z + of |-R(z)| = 1, or (n — z) — (z + l)(g + 2n — z — 1) = 0, are equal 



g - 2 V2/ p q 2 + 4q - 4 

z± = nH — ±n— A/H I 5—9 ■ 

4 2 V n 8n 2 

A straightforward verification shows that for any q > and all sufficiently large n the following bounds are 
true: 

"(l-f)" 1 ^-! * -<"(l-f)-^^-^. (4.20) 
Since z_ is the only root satisfying < Z- < n and 

|.R(z)| > 1 for z < z_; \R(z)\ < 1 for z_ < z < n, (4.21) 

q4.20p-fl4.21J) imply that = max < m <„ \9n,n- m \ = max (lff^n-m*l' lsi^-(m*+l)D' where m * is the integer 
satisfying m* < z_ < m* + 1. Hence the statement of the lemma follows from Stirling's formula similarly to 
Leipus et al. (2006). Lemma 14.21 is proved. □ 

The main result of this sec. is the following theorem. 

Theorem 4.1 Let {X(i)}, <j)(x) and K n satisfy the conditions of Proposition \4^1\ and (j) n {x)^(f) n {x) be the 
estimators of 4>{x) as defined in (|4.12p . Then 

o (l-i)'- 1 ' Jo (l-i)a- 1 

Proof. The second relation in (|4.22p is immediate from (|4.12p and (14.141) . Next, 

Mx) - <t>(x) = &{Mx) - m) + <k*)(3f - 1). 
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where 

a 2 w =? n (0)-? n (2) = (g { q) Q y 1 a 

see dH]), ([43]), (|49]), (jlTTTB . Hence the first relation 
®w ~ a w 0- We have 

E(a 2 w -a 2 w ) 2 = a 4 w E( J\( n (x) 

< a 4 w E(j\( n (x) 

= ^fsfe- 

9 JO 

see (I4.14p . Theorem 14.11 is proved. 



w(n,0 = Vw / Cn(^)(l - x) q 1 dx, 
JO 

in (I4.22p follows from the second one and the fact that 

C(x))(l-s)« -1 da;) 2 

C(x)) 2 (l - xf- l dx J\l - x) q - l dx) 

((x)) 2 (l — x) q ~ 1 dx —7-0, as n — > oo, 

□ 



Remark 4.1 The optimal choice of q (minimizing the integrated MISE in (|4.22p ) is not clear. If <j) satisfies 
([3.ip then (|4.7p is satisfied with any < q < 2 + 2/3. Simulations in Leipus et al. (2006) and Celov et al. 
(2010) show the "optimal" choice of q might be close to /3 which is generally unknown. 

Remark 4.2 An interesting open question is asymptotic normality of the mixture density estimators in 
(|4.12p for non-Gaussian process {3t(i)} (|1.4[) . extending Theorem 2.1 in Celov et al. (2010). The proof of the 
last result relies on a central limit theorem for quadratic forms of moving-average processes due to Bhansali 
et al. (2007). Generalizing this theorem to mixed ID moving averages is an open problem at this moment. 
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